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ABSTRACT 

Objective In global health considerable attention is 
focused on the search for innovations; however, reports 
tracking their adoption in routine hospital settings from 
low-income countries are absent. 
Design and setting We used data collected on a 
consistent panel of indicators during four separate cross- 
sectional, hospital surveys in Kenya to track changes over 
a period of 11 years (2002-2012). 
Main outcome measures Basic resource availability, 
use of diagnostics and uptake of recommended practices. 
Results There appeared little change in availability of a 
panel of 28 basic resources (median 71% in 2002 to 
82% in 2012) although availability of specific feeds for 
severe malnutrition and vitamin K improved. Use of 
blood glucose and HIV testing increased but remained 
inappropriately low throughout. Commonly (malaria) and 
uncommonly (lumbar puncture) performed diagnostic 
tests frequently failed to inform practice while pulse 
oximetry, a simple and cheap technology, was rarely 
available even in 2012. However, increasing adherence 
to prescribing guidance occurred during a period from 
2006 to 2012 in which efforts were made to 
disseminate guidelines. 

Conclusions Findings suggest changes in clinical 
practices possibly linked to dissemination of guidelines at 
reasonable scale. However, full availability of basic 
resources was not attained and major gaps likely exist 
between the potential and actual impacts of simple 
diagnostics and technologies representing problems with 
availability, adoption and successful utilisation. These 
findings are relevant to debates on scaling up in low- 
income settings and to those developing novel 
therapeutic or diagnostic interventions. 



INTRODUCTION 

The Millennium Development Goals (MDGs) 
helped bring international attention to the need to 
reduce child mortality globally. Although subse- 
quent reports suggest progress this is least marked in 
many African countries where changes at national 
scale in coverage of essential primary healthcare 
interventions has often been limited.^ In Kenya 
although child mortality has fallen from 98/1000 to 
73/1000 live births between 1990 and 2011, pro- 
gress is insufficient to meet MDG targets with 40% 
of under 5 mortality now attributable to neonatal 
mortality.^ In common with other settings increas- 
ing recognition is being given to the need for 
broader health system strengthening to improve the 
health of its 6.8 milHon children aged under 5, 
107 000 of whom die annually. The ability of the 



What is already known 



► District hospitals are an important part of the 
primary healthcare system but often provide 
poor quality of care in low-income settings. 

► Considerable effort is devoted to developing 
new recommendations and technologies to 
improve hospital care but adoption in 
low-income settings is rarely explored. 

► Adoption of innovations spanning new 
recommendations and technologies has 
proceeded slowly in developed countries. 



What this study adds 



► No change was followed by slow change in 
clinical practices over 6 years in Kenyan 
hospitals, possibly linked to dissemination of 
guidelines at scale. 

► Major gaps exist between potential and actual 
impacts of simple diagnostics and technologies 
highlighting problems with availability, 
adoption and successful utilisation. 

► Data to support routine monitoring of hospital 
care, outcomes and uptake of innovations are 
completely inadequate but much needed 



first referral (district hospital) level to support child 
survival seemed first to gain attention after publica- 
tion in 2000 of the work of a WHO team.^ This 
work indicated limited capacity to provide appropri- 
ate interventions and very poor adoption of recom- 
mended practices and technologies in district 
hospitals, findings subsequently substantiated by 
others in a number of settings.^"^ Yet, over the past 
two decades considerable resources have been 
devoted to the development of new therapeutic and 
diagnostic technologies. Indeed, these themes are 
common across four of the five research challenges 
defined by The Wellcome Trust as major goals while 
for The Bill and Melinda Gates Foundation All 
strategies underscore the role of technology'.'^ ^ As 
district hospitals typically serve as hubs linked to 
multiple primary care facilities and are likely to have 
important roles in formal and informal knowledge 
networks in rural areas, we suggest they may be a 
useful general barometer of the routine adoption of 
innovations in health systems. 
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Here, therefore, we use observations collected over an 
11 -year period to track w^hether there have been any improve- 
ments in essential paediatric hospital services and track the 
adoption of basic national and international guideline recom- 
mendations. Importantly WHO and national guidelines for 
management of the seriously ill child vs^ith common diseases 
have been available since 2000 in aggregated form and earlier in 
disease-specific programme guidance and provide common, 
basic standards for assessments across this period. In Kenya spe- 
cific efforts to develop and promote these guidelines in a 
simple, cheap format began in 2006^ w^ith distribution of 
10 000 copies in 2007/2008 and 12 000 copies in 2010/2011.^^ 
During this period, a training programme to support use of 
guidelines also reached over 1500 clinicians and nurses (less 
than 10% of the public sector health w^orkforce) and w^as inte- 
grated into undergraduate and postgraduate teaching in the 
largest medical school from 2008.^^ Although there have been 
many other health interventions over the decade examined, w^e 
are not aw^are of any other specific, major efforts targeting 
implementation of such inpatient paediatric guidelines. In 
describing the adoption of basic diagnostics, technologies and 
practice recommendations, it is not our purpose to dmw any 
inference on the effectiveness of Kenyan efforts to popularise 
guidelines. Instead such efforts are part of the context from 
w^hich data are draw^n that w^e use to pose questions about the 
adequacy of progress and, more generally, our ability to deter- 
mine w^hether innovations that should be efficacious are avail- 
able and successfully used in routine settings. 

METHODS 

We make use of data collected as part of different studies using 
similar methodology and tools (described in detail in^ ii-i3j 



from a period spanning 2002 to 2012 w^ith the surveys and 
available data summarised in table 1. Each survey received 
appropriate ethical and institutional approval at the time it was 
undertaken. In brief they involved 14 hospitals and examination 
of 641 case records in 2002 and 8, 17 and 22 hospitals and 
2135, 952 and 1298 case records divided reasonably evenly 
across sites in 2006, 2009 and 2012, respectively. Core indica- 
tors remained the same across surveys including the ability to 
offer key diagnostic tests for: malaria, HIV rapid testing, haemo- 
globin, blood glucose and lumbar puncture for meningitis; 
together w^ith the availability of two additional diagnostic tools, 
blood-based total biHrubin measurement (for the assessment of 
neonatal jaundice) and pulse oximetry for paediatric admissions. 
The availability of key therapeutic or practice resources for man- 
aging sick children or new^borns was also assessed by direct 
observation of survey team leaders and included: the proportion 
of 28 key resources (9 items of equipment and 19 consumables) 
available at the time of survey and the specific availability of: 
paediatric and neonatal bag valve mask devices, specifically for- 
mulated milk feeds for severe malnutrition (F75/F100), vitamin 
K for neonatal prophylaxis and phototherapy equipment for 
neonatal jaundice. 

Finally, w^e examined use of the five important diagnostic 
tests (table 1, data from 2002, 2006 and 2012) and adherence 
to one clinical practice guideline, unchanged since 2000 or 
earlier, for each of malaria, pneumonia and diarrhoea (data 
from 2002, 2006, 2009 and 2012). These were: use of a 
quinine loading dose, once daily gentamicin (no data for 
2009) and a correct fluid plan for children with severe dehy- 
dration (table 1). As paediatric prescribing is based on weight 
we also tracked whether clinicians documented this in the case 
record. 



Table 1 Basic characteristics of four hospital surveys conducted over the period 2002 to 2012 and definitions of patient level indicators 





2002^ 


2006" 


2009^^ 


2012^^ 


Number of 


14 


8 


17 


22 


hospitals 










Hospital 


Purposeful 


Purposeful 


Purposeful 


Purposeful 


selection 










Total cases 


641 


2135 


952 


1298 


examined 










Case 


Convenience sample of children 


Random sample of paediatric 


Convenience sample of paediatric 


Convenience sample of paediatric 


selection 


on ward during survey period 


inpatient records over six months 


inpatient records from most recent 


inpatient records from most recent 


process 


with acute non-surgical illnesses 


period prior to survey with acute 


discharges with malaria, pneumonia 


discharges with acute non-surgical 






non-surgical illnesses 


and diarrhoea 


illnesses 



Indicator calculations for children with an admission diagnosis of an acute, non-surgical illness 

Use of malaria testing Proportion with an admission diagnosis of malaria for whom a malaria test (blood slide examination or rapid test) is 

ordered to substantiate diagnosis 

Use of HIV testing (at least rapid testing) Proportion for whom an HIV test is requested (typically a first rapid test). Routine HIV testing for all admissions has been 

recommended in Kenya as part of formerly diagnostic testing and counselling and latterly provider initiated testing and 
counselling 

Use of haemoglobin measurement Proportion with clinically documented pallor for whom a measured haemoglobin is requested as a standalone test or as 

part of a full blood count using any available laboratory method 
Use of blood glucose measurement Proportion of admissions for whom a blood glucose measurement is requested/documented either as a rapid bedside test 

or as a formal laboratory test using any available laboratory method 
Use of lumbar puncture to identify meningitis Proportion of all admissions for whom a lumbar puncture is requested/documented by the admitting clinical team to rule 

out/rule in meningitis 

Indicator calculations among children with specific admission diagnoses 

Use of a quinine loading dose Proportion with an admission diagnosis of malaria for whom a quinine prescription began with a loading dose to initiate 

therapy 

Use of once daily gentamicin Proportion of children prescribed gentamicin in whom therapy was based on the recommended once daily regimen 

Use of a specific fluid plan for children with Proportion of children given iv fluids for severe dehydration in whom the nature, volume and duration of initial fluids 
severe dehydration prescribed matched national and international recommendations 
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Statistical analysis 

We present simple frequencies for indicators measured at hos- 
pital level and use the median of hospital-specific proportions 
or simple aggregate proportions as a point estimate for indica- 
tors based on evaluation of multiple cases from each survey. As 
surveys did not employ random sampling of facilities and 
records we do not provide estimates of precision around these 
point estimates. Neither is further statistical testing of change or 
trends appropriate given the variation in facilities sampled and 
sampling approaches. We accept the limitations of this approach 
and suggest a very cautious interpretation of results but use 
these crude data to draw^ basic lessons now^ w^hile highlighting 
the need for better data in the future to understand adoption of 
innovations. 

RESULTS 
Basic resources 

The median availability of a set of 28 very basic resources in 
hospitals was 20/28 items (71%, range 7/28 to 24/28), 21.5/28 
(77%, range 14/28 to 25/28) and 23/28 (82%, range 15/28 to 
28/28) in 2002, 2006 and 2012, respectively Although the 
nature of missing resources varied across place and time, there 
seemed consistent difficulties in access to antistaphylococcal 
penicillins and phenobarbitone injection, the latter being the 
mainstay of treatment for prolonged convulsions in children 
and the only therapy routinely recommended for neonatal con- 
vulsions in Kenya. The specific availability of feeds for children 
M^ith severe malnutrition and resuscitation equipment increased 
from 2006 over the period examined (table 2). Some progress 
was apparent for availability of vitamin K to prevent haemor- 
rhagic disease of the new-born w^ith additional data suggesting 
parallel improvements in use; 19/189 (10%) and 843/1213 
(70%) eligible new^borns received vitamin K in 2006 and 2012, 
respectively. 

Basic diagnostics 

All hospitals at all time points had the ability to offer four key 
diagnostic tests: malaria blood slide, haemoglobin measurement, 
blood glucose measurement and HIV testing (table 2). The 



ability to examine cerebrospinal fluid after lumbar puncture or 
measure total bilirubin in blood improved over time (table 2, 
note: transcutaneous bilirubin measurement is not available at 
all). Pulse oximetry w^as not available in any hospital until 2012 
and then in only 3/22 sites (table 2). Laboratory testing of chil- 
dren M^ith a clinical diagnosis of malaria w^as common at all time 
points (84% to 91% cases) w^hile requests for a haemoglobin 
measurement in children documented to have pallor were some- 
w^hat less common (49% to 76%) (figure 1, Panel A). 

The proportion of paediatric admissions for w^hom blood 
glucose, lumbar puncture or HIV testing was requested 
increased after 2006. In the case of HIV testing it has been 
national policy since at least 2004 to test all paediatric admis- 
sions. Requesting testing in less than 20% of admissions overall 
in 2012 therefore still appears inappropriately low. Clinical 
signs are poor at identifying hypoglycaemic children, testing is 
cheap, 10% or more of paediatric admissions may be hypogly- 
caemic and it is a clear risk factor for death. As national guide- 
lines recommend testing of all severely ill children testing few^er 
than 10% of admissions also still seems inappropriately low^. 
Meningitis is uncommon but should be ruled out by testing at 
risk children. Requesting lumbar puncture increased from a rate 
of 1.2% (in 2002) to 7.4% of all admissions in 2012, a period 
after introduction of Haemophilus influenzae Type B (Hib) (in 
2001) and pneumococcal vaccines (in 2011). A correct rate of 
lumbar puncture is not possible to define but in most Kenyan 
hospitals at least 10% of children are admitted with, fever com- 
plicated by convulsions (unpublished data). How^ever, anecdotal 
experience suggests few^ of the requested lumbar punctures 
are actually performed w^ith results of tests rarely found in 
records. 

Changes in prescribing practice 

Availability of paediatric guidelines improved (table 2) after spe- 
cific efforts to produce and disseminate a simple, low^-cost 
version. There was little evidence of adherence to guidelines 
between 2002 and 2006. How^ever, use of a quinine loading 
dose, once daily gentamicin and correctness of fluid plans for 
children w^ith severe dehydration all improved between 2006 



Table 2 Resources for providing effective paediatric and neonatal care in Kenyan district hospitals illustrated using data on four key indicators evaluated in the period 
2002-2012 



2002 



2006 



2009 



2012 



Availability of key therapeutic resources 

F75/F100 for children with severe malnutrition 

Vitamin K for neonatal prophylaxis 

Appropriate bag-valve-mask devices in paediatric areas 

Availability of working phototherapy device 

Availability of basic diagnostic tests 

Pulse oximetry 

Malaria slide or other diagnostic 
Haemoglobin measurement 
Blood glucose testing 

Microscopy, Gram stain and culture for CSF 

Bilirubin measure (blood based) 

HIV testing (rapid) 

Availability of information resources 

Paediatric guidelines available 

Newborns given medical record 



0/14(0%) 
2/14 (14%) 
0/14 (0%) 
8/14 (57%) 

0/14(0%) 
14/14(100%) 
14/14(100%) 
14/14 (100%) 
7/14 (50%) 
6/14(43%) 
14/14(100%) 

0/14(0%) 
0/14 (0%) 



2/8 (25%) 
0/8 (0%) 
6/8 (75%) 
5/8 (63%) 

0/8 (0%) 
8/8 (100%) 
8/8 (100%) 
8/8 (100%) 
8/8 (100%) 
3/8 (38%) 
8/8 (100%) 

0/8 (0%) 
0/8 (0%) 



16/17 (94%) 
12/17 (71%) 
12/17 (71%) 
14/17 (82%) 

0/17 (0%) 
17/17 (100%) 
17/17 (100%) 
17/17 (100%) 
17/17 (100%) 
16/17 (94%) 
17/17 (100%) 

14/17 (83%) 
-t 



22/22 (100%) 
18/22 (82%) 
22/22 (100%) 
19/21* (90%) 

3/22 (14%) 
22/22 (100%) 
22/22 (100%) 
22/22 (100%) 
22/22 (100%) 
19/22 (86%) 
22/22 (100%) 

16/22 (73%) 
20/22 (91%) 



Results expressed as number of hospitals in which resource was available over number of hospitals evaluated (%). 
*Data missing for one hospital. 
tData not collected in survey. 
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A 

100% 




2002 2006 2009 2012 



Figure 1 Panel A: Use of diagnostic tests in children admitted to 
hospital. Y-axis represents proportion of eligible population with test 
ordered (see table 1 for definitions), X-axis represents year of survey. 
Malaria blood slide — black line; Haemoglobin — blue line; HIV test — 
red line; lumbar puncture — green line; blood glucose — orange line. 
Panel B: Clinical practices indicating adherence to guidelines. Y-axis 
represents proportion of eligible population with treatment prescribed 
consistent with guideline (see table 1 for definitions), X-axis represents 
year of survey. Weight documented in medical record — red line; 
quinine loading dose — blue line; once daily gentamicin — purple line 
(no data for 2009); correct intravenous fluid regimen — green line. 

and 2012 (figure 1, Panel B), as did documentation of patient 
weight, although there remains considerable room for further 
improvement. 

Service delivery information 

Recognising sick newborns as admissions has improved (table 2). 
However, in 2009 and 2012 data quality were too poor to cal- 
culate hospital-based neonatal mortality rates and data on still- 
births were generally missing or unreliable. Even for paediatric 
mortahty age stratified estimates in 2009 and 2012 could only 
be estimated for 7/17 and 8/22 hospitals, respectively. When 
attempted in 2009 a 12-16-fold difference in reported inpatient 
infant mortality rates was observed raising doubts about the 
credibility of such data even where available. 

DISCUSSION 

One in five basic resource items for providing care to seriously 
ill children and newborns were typically not available over the 



period of study but improvements were seen for some key areas 
(eg, feeds for malnutrition and vitamin K). Compliance with 
clinical prescribing recommendations in three areas improved 
from below 20% to above 60% over a period of 6 years, a 
period during which guidelines were widely disseminated in a 
simple cheap format and knowledge-based and skills-based 
training was expanded through in-service and preservice train- 
ing. Over the same period there was some improvement in the 
use of basic diagnostics but this was much more limited. 

Alternative explanations for any improvement observed might 
include simple secular changes in hospital services. Although gov- 
ernment expenditure on health did rise in absolute terms over this 
period, there was no significant increase year on year relative to 
population growth and inflation. Government partner spending 
did dramatically increase. For example grants to Kenya from the 
GFATM have amounted to $2655 million since 2000 and USAID 
report allocating approximately 84% of their country budgets to 
health, amounting to sums of over $330 million per year in 2010 
and 2011.^^ ^'^ Much of this funding has been directed to support- 
ing HW, malaria or TB specific primary care services; however, 
there has been little direct support for inpatient paediatric hospital 
care. Perhaps indicative of this one of the simplest and cheapest 
bedside diagnostic tests, pulse oximetry, remained largely unavail- 
able over the entire period while CD4 analysers are now present 
in most hospitals in Kenya. 

While it is hard to discern clearly which factors contributed to 
improvements we believe greater knowledge and thus better advo- 
cacy may have been important in addressing specific resource gaps 
(such as appropriate sized resuscitation devices). We believe 
access to basic guidelines, formal and informal knowledge sharing 
mechanisms, engagement with the national paediatric association 
and a resulting change in professional expectations supported 
greater attention to paediatric prescribing in particular. We 
contend that multiple factors contributed to persistent relatively 
poor use of basic diagnostics including: financial constraints, lack 
of trust from clinicians in timely access to quality results (reducing 
requests), role ambiguity in the case of HFV testing and reluctance 
to pass costs of testing on to patients. 

Our findings are important for a number of reasons. First, if 
we wish to see changes at scale major, sustained and adequately 
resourced efforts will be needed. These should comprise wide, 
'whole system' interventions if our aim is to improve overall 
service delivery.^^ Second, although considerable funding is 
being devoted to the development of novel diagnostics, our data 
suggest that even when cheap diagnostic technologies are 
'brought to market' they will not necessarily become available 
or be used. To achieve this we must also solve implementation 
challenges that are as much to do with the complexity of the 
political, social and professional systems as their cost and avail- 
ability.^^ Those supporting the development of such innova- 
tions would perhaps do well to try and understand these 
challenges and explore, for example, why pulse oximetry has 
failed to become a standard of care in African hospitals. 

It is clear that the data presented here are limited in coverage, 
scope and quantity. We acknowledge this and accept that find- 
ings should be interpreted cautiously. However, an additional 
purpose of this report is to highlight major inadequacies in 
information systems. These are not providing reliable routine 
data on outcomes of hospital care and provide no real insight 
into the process of care during service delivery. Yet both are crit- 
ical to an understanding of health system performance. As we 
invest in new innovations there appears a clear case, therefore, 
to invest in appropriate information systems and analyses to 
assess their actual impact. 
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In conclusion, our data suggest slow but steady progress in 
the adoption of signal clinical practices relevant to management 
of common serious illnesses among paediatric admissions in a 
setting where there have been efforts to improve such practices. 
However, a decade after highlighting inadequacies in basic 
resources these are not uniformly available while adoption and 
use of diagnostics and technologies often remains very limited. 
Unfortunately, we are not aware of reports from other settings 
with which we can compare our findings, something that may 
reflect the paucity of health services data from low-income 
countries. As we approach and move beyond 2015 continued 
improvements in child survival we believe will require broadly 
effective health systems and health information systems. We 
suggest that the performance of district hospitals in delivering 
essential services should be an integral part of national monitor- 
ing and system strengthening. 
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